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(54) Dala transmission method, data trdnamlssion system, data receiving method, and data 
receiving apparatus 



(57) A data transmission system comprises a data 
transmission apparatus for transmitting plural preces of 
object data for reproducing plural objects constituting a 
scene, and a data receiving apparatus for receiving the 
plural pieces of object data an*;! reproducing the scene 
on the basis of the object data- The data transmission 
apparatus comprises a first transmission unit for trans- 
mitting first object data, amongst the plural pieces of 
object data, such ihat reproduction of the scene is per- 
formed at the receiving end on the basis of the first 
object data after the transmission of the first object data 
has been completed, and a second transmission unit for 
transmitting second object data other than the first 
object data, amongst the plural pieces of object data, 
such that reproduction of the scene is performed at the 
receiving end on the basts of the second object data 
during the transmission of the second object data. 
Therefore, the consumption of the transmission band of 
the network is minimized, and reliable image reproduc- 
tion at the receiving end is assured regardless of trans- 
mission errors. 
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Description 

FIELD OF THE iNVENTlON 

[0001 1 The present invention relates to a data trans- ^ 
mission method^ a data transmission system^ a data 
receiving meihod, and a data receiving apparatus and, 
more particularly, to a method for transmitting image 
data of MPEQ4, through the Internet, according to a 
transmission mode adapted to the type of the image io 
data. 

BACKGROUND OF THE INVENTION 

[0002] In recent years, we have greeted ihe age of is 
multimedia in wnicn audio, video, and other data are 
integrally handled^ and the conventional information 
media, i.e., means for transmitting Information to men, 
such as newspapers, magazines, televisions, radios, 
and telephones, have been adopted as the targets of 20 
multimedia. Generally^ "multimedia" means media in 
which, not only characters, but also diagrams, 
speeches, and especially images are simultaneously 
expressed in relation with each other. !n order to handle 
the conventional Information media as the targets of 25 
multimedia. It is necessary to represent the data in dig- 
ital formats. 

[0003] When the quantity of data possessed by 
each of the above-described information media is esti- 
mated as the quantity of digital data, in the case of char- so 
acters, the data quantity per character is only 1 ~2 byte. 
However, in the case of speech, the data quantity is 
64kbt!s per second (quality for telecommunication). Fur- 
ther, in the case of moving picture, the required data 
quantity Is more than lOOMbits per second (quality for 35 
current television broadcasting). So, in ihe above- 
described information media, it is not practical to handle 
such massive data as it is in the digital format. For 
example, although visual telephones have already been 
put to practical use by the ISDN (Integrated Services 40 
Digital Network) having a tiansiriisslon rate of 
S4^kbps~1 .5Mbps, it is impossible to transmit an image 
from a television camera as it is by the ISDN. 
[0004] So. data compression techniques are 
demanded. For example, for visual telephones, the 45 
moving picture compression techniques bas^ on the 
H-261 and H.S63 standards which have been standard- 
ized by ITU-T (International ToJ^communlcation Union - 
Telecommunication Sector) are employed. Further, 
according to the data compression technique based on 50 
the t\flPEG1 standard, it is possible to record image data 
as well as audio data In an ordinary music CD (compact 
disk). 

[00051 MPEG {Moving Picture Experfe Group) is an 
international standard relating to a data compression 55 
technique for an image signal corresponding to a mov- 
ing picture, and MPEG1 is the standard for compressing 
moving picture data to 1 .5Mbps, i.e., data of a television 



signal to about 1/100. Since the transmission rate of the 
targets to which the MPEG1 standard is directed is lim- 
ited to about 1.5Mbp$, in MPEQ2 which has been 
standardized to meet the demand for higher image 

quality, moving picture d^ia is compresBod to 2-15 
Mbps. 

[0006] Furthermore, under the existing circum- 
stances, standardization of MPEG4 Is now proceeded 
by the working group for standardization of MPEQ1 and 
MPEG2 (ISO/IEC JTC1/SC29/WG1 1), and ttiis MPEG4 
envies coding and signal processing in ch\eot units, 
and thereby realizes new functions required fn the ago 
of multimedia. 

[0007] Figures 7, and 8(a)-8(d) are diagrams for 
explaining the object-by-object coding process. 
[OOOS] in MPEG4, an image G corresponding to 
one frame shown in figure 7 is treated as a composite 
image which is obtained by compositing plural objects. 
The image G is composed of a background B {fiaure 
8(a)), a big fish F1 as a first foreground (figure S(b)), a 
small fish F2 as a second foreground (figure 8 (c)), and 
a seaweed F3 as a third foreground (figure 8(d))- 
[0009] Furtiier, in ihe object-by-object uociing proc- 
ess based on MPEQ4, image data corresponding to the 
respective objects constituting the composite image G 
(the background B and the first to third foregrounds 
F1-F3) are encoded object by object. Then, coded 
image data (object data) corresponding to the respec- 
tVe objects are transmitted through a transmission 
medium. 

[0010] On the other hand, in the object-by-object 
decoding process based on MPEG4, the coded image 
data corresponding to the respective objects are 
received object by object or in the multiplexed state, 
through the transmission medium. The received coded 
image data are decoded object by object, thereby gen- 
erating decoded image daia corresponding to each 
object. Then, the decoded image data corresponding to 
the respective objects are composited, thereby generat- 
ing reproduced image data (scene data) corresponding 
to the composite image (decoded and reproduced 
image) G. 

[001 1 1 In the above-described process for transmit- 
ting the object-by-objeot coded image data, not only the 
coded image data (object data) obtained by coding the 
image data object by object but also control information 
are transmitted through the transmission medium. The 
cor^trol information Includes, for example, scene 
description information which indicates the locations of 
the respective objects in one frame for compositing and 
displaying the objects, i,e,, the display area of the com- 
posite image (refer to figure 15(b)). 
[0012] Meanwhile, in recent years, a video distribu- 
tion system has spread, in which the user can gain 
acness to his/her fsvorite moving picture through ^ com- 
puter network, 

[001 3] Figure 9 is a schematic diagram for explain- 
ing such video distribution system. 
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[001 4] In a video distribution system 700, a plurality 
of networks 701, 702 and 703 are connected to each 
other, and a plurality of servers 705, 70S and 707 which 
distribute video information are connected to the net- 
works 701 , 702 and 703, respecilv©!/. ^ 
Further, a plurality of video reception and reproduction 
terminal units (hereinafter referred to simply as termi- 
nal units") which receive the distributed video informa- 
tion are connected to the respective networks 701 -703. 
To simplify the description, only a terminal unit 704 con- w 
nected to the network 701 is shown m figure 9. 
1001 5] In th0 vid0O dretribution syetom 700 so con- 
structed, when the terminal unit 704 receives video 
information distributed from the server 70S, initially, the 
terminal unit 704 contacts the server 705, and effectu- i5 
ates a cfrcuit connection with the server 705. Thereaf- 
ter, the terminal unit 704 receives coded image data 
distributed from the server 705, and reproduces the 
irrtage data by decoding. 

10016] Hereinafter, a description will be given of a 20 
specific process of obtaining predetermined image data 
through the Internet as the above-described network. 
[0017] As described above, a plurality of iriforfna- 
tion sources (servers) are connected to the Internet 
which forms the network in the current information dis- 2& 
tribution system, and the respective information sources 
contain, for example, information of home pages relat- 
ing to various subjects. Now it is assumed that the ter- 
minal unit 704 is connected to an information source 
having information of a home page HP the title of which so 
is "World of Dinosaurs", and this home page HP is dis- 
played on a display of the terminal unit 704. 
10018] In this home page HP, as shown in figure 1 0, 
items of video scenes relating to dinosaurs are repre- 
sented by character strings "scene 1 ' - "scene 3". and 35 
the display areas of these character strings are desig- 
nation areas D1-D3 for designating the moving pic- 
tures. In this state, the user moves the mouse pointer 
MP to the designation area D1 corresponding to the 
character string "scene V in the home page HP and 40 
clicks the mouse, ^n image MPs of a video soene P 
linked to the character string "scene 1" is displayed as 
shown in figure 11(a). 

10019] As a data transmission method for transmit- 
ting the image {text, audio, and video) data on the Inter- 45 
net download type transmission and stream type 
transmission are currently employed. 
[0020] In tho dowrtlocid typo tranomiocfon, a video 
file {image data) transmitted from a distribution server is 
once copied at the terminal and, thereafter, the image so 
corresponding to the video file is reproduced. So, the 
terminal cannot start image reproduction until the tile 
transmission is completed. That is, there is a latency 
time for transmission and. therefore, the download type 
transmission is not suitEM^Ie for tong-hours reproduction be 
of video and audio. On the other hand, in the stream 
type transmission^ while transmitting video data or the 
like from the distribution server to the terminal, image 



reproduction is carried out on the basis of the received 
data at the terminal end. 

[0021] Therefore, data to be processed in real time, 
such as video data and audio data, are transmitted by 
the stream type transmission. 
[0022] Recently, stream type transmission using a 
protocol called RTP (Real-time Transport Protocol) has 
been mainly employed. In a communication system In 
which a distribution server (transmitting end) S and a 
terminal (receiving end) T such as a personal computer 
are connected by a circuit such as ISDN in the internet 
as shown in frgur© 16, transmission of image data is 
performed according to the RTR 
[0023] In the data transmission according to the 
RTP, processes for the respective packets are synchro- 
nized between the transmitting end and the receiving 
end by using time stamps as time information, and 
asynchronous (late arrival) packets and error packets in 
which transmission errors have occurred are discarded 
at the receiving end. Further, discarded or lost packets 
are detected at the receiving end, according to the 
absences of sequence numbers given to these packets. 
100243 Under the circumstances described above, 
in recent years, a method for transmitting image data of 
MPEQ4 through the Internet has been examined. 
{0025} In MPEG4, the video scene P shown in fig- 
ure 1 1(a) Is treated as a composite image G1 which Is 
composed of four objects obi, ob2, obS, and ob4 (refer 
to figure 1 1(b)). That is, in this composite image Gl , the 
object obi is a background as a still picture showing the 
sky or the like (figure 12(a)), ^e object ob2 is at irst fore- 
ground as a cyclic moving picture showing a volcano 
(figure 12(b)), the obj^ ob3 is a second foreground as 
a moving picture showing a big dinosaur (figure 12(c)), 
and the object ob4 is a third foreground as a moving pic- 
ture showing a small dinosaur (figure 12(d)), 
[0026] Hereinafter, a data transmission meihod 
based on MPEG4, which is currentiy examined, will be 
described by using figures 16(a) and 16(b), in the fol- 
lowing description, a plurality of servers may be con- 
nected to the terminal T 

[0027] In this data transmission method, image 
data corresponding to one scene (composite image) 
treated in MPEG4 is obtamed for each of plural obiects 
constituting the scene, from a predetermined server, by 
the RTP, through the Internet. 
[00281 Initialiy, as already described with respect to 
figure 10^ in the ^tale where the home page HP ie dis- 
played on the display unit of the terminal T, when the 
user cricks the mouse at the designation area D1 corre- 
sponding to the character string "scene 1 '\ a session 
description protocol (SDP) (figure 13(a)) and an initial 
object descriptor (lOD) (figure 13(b)), which correspond 
to the scene (composite image) Gl and are linked to the 
character string "scen^ 1", are transmitted from the 
server S containing these data to the terminal T through 
the Internet (refer to figure 9). 
[0029J With reference to figure 13(a). in the SDP 
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(hereinafter also referred to as SDP information), the 
type of data is described In association with a transmis- 
sion mode and an URL (Uniform Resource Locator) of 
the data, which are required for reproduction of the 
composite Em^ige. To specific, as the above-men- s 
tioned data, there are not only the object data (entity 
data) for reproducing the respective objects constituting 
the scene, i,e., image data, audio data, and text data, 
but also control information, Le.» an initial object 
descriptor (lOD), an object descriptor stream (CDS), w 
and a scene description stream (SDS), 
[OOSOI Further, as shown in figure 13(b), in the ini- 
tial object descriptor (hereinafter also referred to as lOD 
information}, data of the object descriptor (00) corre- 
sponding to the ODS itself, and data of the object is 
aescnptor (OD) corresponding to the SDS itself, are 
stored, 

[0031] Further, as shown in figure 14(a), in the ODS 
{hereinafter also referred to as ODS information), data 
of object descriptors (OD) of all objects constituting the 20 
scene are stored. Further, as shown In figure 14(b), in 
the SDS (hereinafter also referred to as SDS informa- 
tion), data of scene descriptions GP1 ~3Dn correspond- 
ing to predetermined times t1 ~tn are stored. 
[0032] When the SDP information and the lOD 25 
information are transmitted to the terminai X the termi- 
nal T requests the server S to transmit the ODS infor- 
mation corresponding to the respective objects (i.e., 
object descriptors 0D1~0D4) and the entity data, by 
specifying their uniform resource locators (URL) and so 
synchronization sources (hereinafter referred to simply 
as SSRC). Further, the terminal T requests the server S 
to transmit the SDS information corresponding to the 
scene Gl (i.e., the scene descriptions SD1--SDn), by 
specifying Its URL and SSRC. The SSRC is a channel 35 
ID for identifying a channel of the RTP packet. 
[0033] On receipt oi the request from the terminal T. 
the sender S packetizes the requested data, gives the 
SSRC specified by the terminal to each packet, and 
transmits the packets to the terminal T according to the 40 
RTR 

[0034] The terminal T receives the image data 
(object data) of the respective objects constituting the 
scene Q1, the object descriptors OD1~OD4, and the 
scene descriptions SDI-^-SDn. Based on these data, 45 
the terminal T reproduces and displays the image of the 
scene 01, 

[0035] Ffguro 15(a) shows specific contents of 
the object descriptor OD1 (id-100), and figure 160d) 
shows the specific contents of the scene description so 
SD1 (timetl), 

[0036] However, the image data according to 
MPEG4 includes data (control Information) which pre- 
vents image reproduction if a transmission error occurs 
in this data, such as the SDP information, the lOD infor- ss 
mation, the SDS information, and the ODS Information. 
When such data (control information) is transmitted 
according to the RTR since recovery against the trans- 



mission error is not performed, the state where the 
image data cannot be reproduced, occurs frequently at 
the receiving end. 

[0037] Further, when the download type transmis- 
sion and the stream type transmission are performed in 
arbitrary order, the image data are sometimes transmit- 
ted by the download transmission while reproducing the 
image data transmitted by the stream type transmis- 
sion, tn this case, the data transmission quantity during 
scene reproduction increases significantly, and the con- 
sumption of the transmission band of the network can- 
not b& minimi2ed. 

[0038} Further, although the number of the objects 
constituting the scene and the hierarchy of the objects 
can be grasped from the SDS information and the ODS 
information, the correspondence between the address 
(URL) of the object data (image data corresponding to 
each object) and each object cannot be obtained. 

SUMMARY OF THE INVENTION 

[0039] The present invention is made to solve the 
above-described problems and has for its object to pro- 
vide a data transmission method, a data transmission 
system, a data receiving method, and a data receiving 
apparatus, which avoid that image reproduction at a 
receiving terminal becomes unreliable due to transmis- 
sion error, and assure reliable image reproduction at the 
receiving terminal even when some transmission error 
occurs. 

[0040] It is another object of the present invention to 
provide a data transmission method, a data transmis- 
sion system, a data receiving method, and a data 
receiving apparatus, which avoid that the data transmis- 
sion quantity during scene reproduction increases con- 
siderably and minimize the consumption of the 
transmission band of the network. 
[0041] It is still another object of the present inven- 
tion to provide a data transmission method, a data 
transmission system, a data receiving method^ and a 
data receiving apparatus, in which each object can be 
associated with the URL (Uniform Resource Locator) of 
image data corresponding to the object, on the basis of 
the SDP (Session Description Protocol) corresponding 
to the scene- 

[0042] Other objects and advantages of the inven- 
tion will become apparent from the detailed description 
th^t follows. The detailed description and specific 
embodiments described are provided only for illustra- 
tion since various additions and modifications within the 
scope of the invention will be apparent to those of skill in 
the art from the detailed description. 
[0043] According to a first aspect of the present 
invention, there is provided a data transmission method 
of transmitting plural pieces of nbjeni dats for reprodun- 
ing plural objects constituting a scene, from the trans- 
mitting end to the receiving end. This method comprises 
a first transmission process of transmitting first object 
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data, amongst the plural pieces of object data, such that 
reproduction of the scene is performed at the receiving 
end on the basis of the first object data after the trans- 
mission of ihe first object data has been completed; and 
a second transmission process of fe-anstniftrng second 
object data other than the first object data, amongst the 
plural pieces of object data, such that reproduction of 
the scene is performed at the receiving end on the basis 
of the second object data during me transmission of the 
second object data. Therefore, extrertie increase in the 
data transmission quantity during scene reproduction is 
avoided, and the consumption of the transmission bard 
of the networl^ is minimized. 

[0044] According to a second aspect of the present 
invention, there is provided a data transmission method 
for transmitting scene data for reproducing a scene, 
from the transmitting end to the receiving end. This 
method comprises a first transmission process of trans- 
mitting first data which is a part of the scene data, in 
accordance with a first transmission protocol which 
does not necessarily perform retransmission against 
transmission errors; and a second transmission process 
of transmitting second data which is a part of the scene 
data, in accordance with a second transmission proto- 
col which performs retransmission against transmission 
errors. The second data is scene description informa- 
tion and object retevant information, the scene descrip- 
tion information indicating the hierarchy of the 
respective objects constituting the scene, by object 
identifiers which are given to the respective objects for 
identifying these objects, and the object relevant infor- 
mation indicating additional information relating to the 
respective objects, in association with the object identi- 
fiers of the respective objects. Therefore, this method 
can prevent Image reproduction at the receiving end 
from becoming unreliable due to transmission error, and 
the receiving end can perform reliable image reproduc- 
tion even when some transmission error occurs, 
[0045] According to a third aspect of the present 
invention, there is provided a data transmission method 
for fransniitling scene data for reproducing a scene, 
from ^e transmitting end to the receiving end. TNs 
method comprises the steps of transmitting object data 
for reproducing plural objects constituting the scene, 
object by object, from the transmitting end to the receiv- 
ing end; and transmitting t^le information from the 
transmitting end to the receiving end, the table informa- 
lion associating an object tdonttf[©r giv^n to each objoct 
for identifying the object, with location information indi- 
cating the location of object data corresponding to the 
object. Therefore, the receiving end can associate each 
object with the location of object data corresponding to 
the object, on the basis of the table information. 
[0046] According to a fourth aspect of the present 
invention, there is provided a data transmission system 
comprising a data transmission apparatus for transmit- 
ting plural pieces of object data for reproducing plural 
objects constituting a scene: and a data receiving appa- 



ratus for receiving the plural pieces of object data and 
reproducing the scene on the basis of the object data. 
The data transmission apparatus comprises a first 
transmission unit for transmitting first object data, 

s amongst the plural pieces of object data, such that 
reproduction of the scene is performed at the receiving 
end on the basis of the first object data after the trans- 
mission of the first object data has been completed; and 
a second transmission unit for transmitting second 

w object data other than Ihe first object data, amongst the 
piurai pieces of object data, such that reproduction of 
the scene Is performed at the receiving end on the basis 
of the second object data during the transmission of the 
second object data. Therefore, extreme increase in the 

15 data transmission quantity during scene reproduction is 
avoided, and the consuinpiion of the tf ansmission band 
of the network is minimized. 

{0D47] According to a fifth aspect of the present 
invenft'on. in the data transmission system of the fourth 

20 aspect, the data transmission apparatus transmits, by 
using the first transmission unit, control information for 
controlling transmission of the object data and repro- 
duction of the objects, as initial data to be transmitted to 
the receiving end in the transmission process for data 

25 corresponding to one scene, the control information 
including transmission mode identification information 
indicating that the object data corresponding to each of 
the objects constituting one scene is to be transmitted 
by the first transmission unit or the second transmission 

30 unit Therefore, in addition to the effect of minimizing the 
consumption of the transmission band of the network, 
this system can prevent image reproduction at the 
receiving end from becoming unreliable due to trans- 
mission error. 

35 [0048] According to a sixth aspect of the present 
invention, there is provided a data transmission system 
comprising a data transmission apparatus for transmit- 
ting scene data for r^roducing a scene; and a data 
receiving apparatus for receiving the scene data and 

40 reproducing the scene. The data transmission appara- 
tus comprises a first transmission unit for iransmiltuig 
first data which is a part of the scene data, in accord- 
ance with a first transmission protocol which does not 
necessarily perform retransmission against transmis- 

45 sion errors; and a second transmission unit for transmit- 
ting second data which is a part of the scene data, in 
accordance with a second transmission protocol which 
performe retranemiecion againet tranemiesion errors. 
The second transmission unit transmits, as the second 

50 data, scene description information and object relevant 
information, the scene description information indicating 
the hierarchy of the respective objects constituting the 
scene, by object identifiers which are given to the 
respedive objects for identifying these objects, and the 

55 object relevant information inrJicatinQ addttionsi Informa- 
tion relating to the respective objects, in association 
with the object identifiers of the respective objects. 
Therefore, this system can prevent image reprcKJuction 



5 



9 



EP1 C^9140A2 



10 



at ihe receiving end from becxjming unreliable due to 
transmission error, and the recei\flng end can perform 
reliable image reproduction regardless of some trans- 
mission error. 

[0049] According to a eoventh aspect of the preoent 
invention, there is provided a data transmission system 
comprising a data transmission apparatus for transmtt- 
ting, object by object, object data for reproducing plural 
objects constituting a scene; and a data receiving appa- 
ratus for receiving the object data and reproducing the 
scene on the basis of the object data. The data trans- 
missior> apparatus comprises an Information fe-ansmis- 
sion unit for transmitting table information which 
associates an object identifier given to each object for 
Identtlying the object, with location information indicat- 
ing the location of object data corresponding to the 
object. Therefore, the receiving end can associate each 
object with the location of object data corresponding to 
the object, on the basis of the table informatron. 
IQ050] According to an eighth aspect of the present 
invention, in the data transmission system of the sev- 
enth aspect the information transmission unit transmits 
the table information in such a manner that ihe table 
information is included tn control information for controh 
ling transmission of the object data and reproduction of 
the objects, the control information being initial informa- 
tion to be transmitted to the receiving end in the trans- 
mission process for data corresponding to the scene. 
Therefore, the receiving end can associate each object 
With the location of dDject data corresponding to the 
object, on the basis of the table information. 
[0051] According to a ninth aspect of the present 
invention, in the data transmission system of the sev- 
enth aspect, the information transmission unit transmits 
the table information in such a manner that the table 
information is included In object relevant information 
which indicates additional information relating to the 
respective objects in association with object identifiers 
of the respective objects. Therefore, the receiving end 
can associate each object with the location of object 
data corresponding 1o the object, on the basie of the 
table information. 

[0052] According to a tenth aspect of the present 
invention, there Is provided a data receiving method for 
receiving plural pieces of object data for reproducing 
plural objects constituting a scene, transmitted from the 
transmitting end, and reproducing the scene on the 
basts of the object data. This n^s^od comprises a first 
receiving process of receiving first object data amongst 
the plural pieces of object data, and reproducing the 
scene on the basis of the first object data after the 
reception ot the object data has been completed; and a 
second receiving process of receiving second object 
data other than the first object data amongst the plural 
pieces of object data and. simultaneously, reproducina 
the scene on the basis of the second object data. There- 
fore, extreme increase in the data transmission quantity 
during scene reproduction is avoided^ and the con- 



sumption of the transmission band of the network is 
minimized. 

[0053] According to an eleventh aspect of the 
present invention, there is providoi a data receiving 

s meUiod for receiving scene data for reproducing a 
scene, transmitted from the transmitting end, and repro- 
ducing the scene. This method comprises a first receiv- 
ing process of receiving first data which is a part of the 
scene data^ transmitted according to a first transmission 

10 protocol which does not necessarily perform retrans- 
mission against fe-ansmission errors; and a second 
receiving process of receiving second data which is a 
part of the scene data, transmitted according to a sec- 
ond transmission protocol which performs retransmls- 

15 sion against transmission errors. The second data is 
scene description information and object relevant intor- 
matlon, ttie scene description information indicating the 
hierarchy of the respective objects constituting the 
scene, by object identifiers corresponding to the respec- 

20 tive objects, and the object relevant Information indicat- 
ing additional information relating to the respective 
objects, in association with the object Identifiers of the 
respective objects, Therefore, this method can prevent 
image reproduction at the receiving end from becoming 

S5 unreliable due to transmission error, and satisfactory 
scene reproduction is performed regardless of some 
fe'ansmission error. 

[0054] According to a twelfth aspect of the present 
invention, there is provided a data receiving method for 

30 receiving scene data for reproducing a scene, transmit- 
ted from the transmitting end. and reproducing the 
scene. This method comprises the steps of receiving 
object data for reproducing plural objects constituting 
the scene, which are transmitted object by object from 

35 the transmitting end; and receiving table information 
transmitted from the transmitting end, the table informa- 
tion associatino an object identifier given to each object 
for identifying the object, with location information irxii- 
cating the location of object data corresponding to the 

40 object. Therefore, during scene reproduction, each 
object can be associated with the location of object data 
corresponding to the object, on the basis of the table 
information, 

[0055] According to a thirteenth aspect of the 
45 present invention, there is provided a data receiving 
apparatus for receiving plural pieces of object data for 
reproducing plural objects constituting a scene, trans- 
mitted from th© tran^rnittlng end, and reproducing the 
scene on the basis of the object data. This apparatus 
so comprises a first receiving unit for receiving first object 
data amongst the plural pieces of object data; a second 
receiving unit for receiving second object data other 
than the first object data amongst the plural pieces of 
object data; and a reproduction unit for reproducing the 
55 scene on the basis of the first object data and the sec- 
ond object data, in which scene reproduction based on 
tiie first object data is performed after reception of the 
first object data has been completed, while scene repro- 
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duclion based on the second object data is performed in 
parallel with the reception of the second object data. 
Therefore, extreme increase in the data transmission 
quantity during scene reproduction is avoided, 
[00561 According to a fourteenth aspect of the s 
present invention, in the data receiving apparatus of the 
thirieerith aspect, control informatton for controlling 
transmission of the object data and reproduction of the 
objects Is received by the first receiving unit, as initial 
data transmitted to the receiving end in the transmission io 
process for data corresponding to the scene; and the 
object dats corresponding to each object is received by 
one of the first and second receiving units, according to 
transmission mode identification information which is 
included in the control information and indicates that the is 
object data is to be received by ihe first receiving unit or 
the second receiving unit. Therefore, in addition to the 
effect of minimizing the consumption of the transmis- 
sion band of the network, this apparatus can prevent 
image reproduction at the receiving from becoming 20 
unreliable due to transmission error 
100671 According to a fifteenth aspect of the present 
invention, there Is provided a data receiving apparatus 
for receiving scene data for reproducing a scene, trans- 
mitted from the transmitting end, and reproducing the 25 
scene. This apparatus comprises a first receiving unit 
for receiving first data which is transmitted as a part of 
the scene data in accordance with a first transmission 
protocol that does not necessarily perform retransmis- 
sion against transmission errors; a second receiving 30 
unit for receiving second data which is transmitted as a 
part of the scene data in accordance with a second 
transmission protocol that performs retransmission 
against transmission errors. The second receiving unit 
receives, as the second data, scene description infor- ss 
mation and object relevant information, the scene 
description information indicating the hierarchy of the 
respective objects constituting the scene, by object 
identifiers corresponding to Ihe respective objects, and 
the object relevant information indicating additional 40 
information relating to the respective objects, in associ- 
ation with the object Identifiers of the respective objects. 
Therefore, this apparatus can prevent image reproduc- 
tion at the receiving end from becoming unstable due to 
transmission error. 45 
[0058] According to a sixteenth aspect of the 
present irwention^ there is provided a data receiving 
apparatus for receiving object data for reproducing 
objects constituting a scene, transmitted object by 
object from the transmitting end, and reproducing the 60 
scene. This apparatus comprises a first receiving unit 
for receiving first data which is transmitted as a part of 
the scene data in accordance with a first transmission 
protocol that does not nec^sarlly perform retransmis- 
sion against Iransmissior^ errors: and a second receiv- 55 
ing unit for receiving second data which is transmitted 
as a part of the scene data in accordance with a second 
transmission protocol that performs retransmission 



against transmission errors. The second receiving unit 
receives, as the second data, table information transmit- 
ted from the transmitting end, the table information 
associating an object identifier given to each object for 
identifying the object with location information indicat- 
ing the location of object data corresponding to the 
object. Therefore, even when some transmission error 
occurs, each object can be associated with the location 
ot object data corresponding to the ctoject on the basis 
of the table information. 

[00591 According to a seventeenth aspect of the 
present invention, in the data receiving apparatus of the 
sixteenth aspect, the second receiving unit receives the 
table information as information included in control Infor- 
mation for controlling transmission of object data corre- 
sponding to the respective objecTs and reproduction 01 
the objects, the control information being received first 
as the scene data corresponding to one scene. There- 
fore, even when some transmission error occurs, each 
object can be associated with the location of object data 
corresponding to the object on the basis of the table 
information, 

[0060] According to an eighteenth aspect of the 
present invention, in the data receiving apparatus of the 
sixteenth aspect, the second receiving unit receives the 
fable information as information Included in object rele- 
vant information transmitted from the transmitting end, 
the object relevant information indicating additional 
information relating to Ihe respective objects, in associ- 
ation with object tdentifiers of the respective objects. 
Therefore, even when some transmission error occurs, 
each object can be associated with the location of 
object data corresponding to the object on the basis ol 
the table information. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0061] 

Figure 1 is a diagram for explaining a data transmis- 
sion system according to a first embodiment of the 
present invention, illustrating the entire structure of 
the system. 

Figure 2 Is a diagram IllustratinQ the contents of 
SDP Information to be transmitted as control infor- 
mation in the data transmission system of the first 
embodiment. 

Figure 3 is a diagram for explaining the relation- 
ships among the contents of SDP information, the 
contents of scene description (SD), and the repro- 
duced scenes. 

Figure 4 is a block diagram illustrating the construc- 
tions of a server (data transmission apparatus) and 
a client terminal (data receiving apparatus) in the 
data transmission sy^em according to the first 
embodiment. 

Figure 5 is a diagram for explaining the procedure 
of session setup in the data transmission system 
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according 1o the first embodiment. 

Figure 6 is a diagram for explaining the procedure 

of session setup in a data transmission system 

according to a second embodiment of the present 

invention. 

Figure 7 is a diagram tJlustrating a composite image 
treated in MPEG4, 

Figures 8(a)-B(d) are diagrams illustrating objects 
constituting the composite image, wherein figure 
8Ca) shows a background, figure 8(b) shows a first 
foreground, figure 8(c) shows a second foreground, 
and figure 8{d) shows a third foreground. 
Figure 9 is a schematic diagram for explaining the 
conventional network system. 
Figure 10 Is a diagram illustrating a screen of a 
home page obtained by the network system. 
Ftgures 1 t{a) and 11(b) are diagrams illustrating a 
moving picture file linked with the home page, 
wherein figure 1 1{a) shows a scene according to 
image data treated in the standard previous to 
1VIPEG4, and figure 1 1 (b) shows a scene according 
to image data treated in MPEG4. 
Figures 12(a)-1£(d) are diagrams tHustratlng 
objects constituting a composite image as tine 
scene shown in figure 11(b), wherein figure 1S(a) 
shows a background as a still picture, figure 12(b) 
shows a first foreground as a cyclic moving Image, 
and figures 12(c) and 12(d) show second and third 
foregrounds as moving pictures, respectively. 
Figures 13(a) and 13(b) are diagrams for explaining 
the contents of SDR information and lOD informa- 
tion, respectively, which are included in the image 
data treated in 

Figures 14(a) and 14(b) are diagrams tor explaining 
the contents of ODS information and SDS informa- 
tion, respectively, which are included in the iOD 
information. 

Figures 15(a) and 15(b) are diagrams for explaining 
object descriptor OD (ld:100) and scene description 
SD1 (time 11), respectively, which are treated in 
MPE04. 

Figure 16 is a diagram illustrating the conventional 
data transmission system for performing data trans- 
mission between a server and a terminal through 
the Internet, according to RIP 

DETAILED DESCRIPTION OF THE PREFEF^RED 
EMBODIMENTS 

[0062] Hereinafter, the inventor's viewpoint and the 
fundamental principle will be described. 
[QQ63J The Inventors of the present invention have 
discovered that, in the process of transmitting image 
data based on iyiPEG4. when control information which 
may cause unreliable scene reproduction due to trans- 
mission errors (i,e.. SDP information, IOD information. 
SDS information, ODS information, etc.) is transmitted 
according to a highly reliable protocol that performs 



data retransmission or the like when a transmission 
error has occurred, bad influences of the transmission 
error on the scene reproduction can be minimized. 

[0064] Further, the inventors of the present inven- 
s tion have discovered the following effect. That is, in the 
case of transmitting image data (scene data) of a scene 
which is reproduced by compositing pre-downioad type 
object data and stream type deject data at the receiving 
end, identifiers for identifying the data formats of the 
10 image data (object data) corresponding to the respec- 
tive objects constituting the scene are described in con* 
trol Information or th& like which is to be downloaded 
initially in the scene data transmission process, and the 
identifiers are downloaded before starting scene repro- 
w dudion at the receiving end, whereby the quantity of 
aata transmined during xm scene reproduction can be 
reduced. 

[0065] The download type object data is image data 
of an object such as a background still picture, a cyclic 

20 moving picture, audio, or text. Once the download type 
object data has been transmitted to the receiving end, 
the receiving end can utilize it until a scene change 
occurs. Such object data is transmitted such that r epro- 
ducllort of the scene is performed on the basis of the 

25 data at the receiving end alter the transmission has 
been completed. On the other hand, the stream type 
object data is image data of a moving picture (object) 
which change with time, and It takes time to download 
bS\ the data from the change of one scene to the change 

30 of next scene. Such object data is transmission such 
that the scene is reproduced on the basis of the data at 
the receiving end during the transmission. 
[0066] Further, the inventors of the present inven- 
tion have discovered that^ by transmitting table informa- 

36 tion which associates an object identifier given to each 
object for Identifying the object with image data (object 
data) of each object, the receiving end can reproduce 
the scene by associating each object with the object 
data corresponding to the object. 

40 [0067] Hereinafter, embodiments of the present 
invention will be described. 

[Embodiment 1) 

4$ [0068] Figures 1-6 are diagrams for explaining a 
data transmission system 1000 according to a first 
embodiment of the present invention. Figure 1 Is a 
schematic diagram ifiustrating th^ ©nttr^ structure of the 
data transmission system. 

BO [0069] The data transmission system 1000 of this 
first emtxxiiment performs data transmission from a 
predetermined server to a client terminal according to 
one of the folf owing two processes: a download type 
transmission process in which download type object 

55 data amongst object data, such as video data, audio 
data, and text data, is transmitted such that reproduc- 
tion d information is performed at the receiving end on 
the basis of the download type object data after trans- 
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mission of llie data has been compieted; and a stream 
type transmission process in which stream type object 
data amongst the object data is transmitted such that 
reproduction of information is performed at the receiving 
^nd during transmission of the s1r©am type object data. 
The download type (hereinafter also referred to as pre- 
download type) object data is object data constituting a 
scene and having a relatively small quantity of data, and 
the stream type object data is object data constituting a 
scene and having a relatively large quantity of data. 
[0070] This system 1 000 includes first to third serv- 
mB 100a, 100bf and 100c having predetermined data, 
and a client (display terminal) 200 which requests each 
server to send necessary data. These servers 
lOOa-IOOc are conneclabie to the client 200 through 
the Internet. The first server (server A) looa holds 
stream type video data, the second server (server B) 
100b holds pre-download type video data, lOO informa- 
tion, and SDP information, and the third server (server 
C) 1 00c holds data of a predetermined home page. The 
video data are image data for reproducing objects con- 
stituting a scene. The lOD information includes SDS 
infoimalion which compiises scene descriptions 
SD1~SDn corresponding to predetermined times tl-tn 
in one scene, and CDS information which comprises 
ob|ect descriptors OD corresponding to all objects con- 
stituting one scene. 

100711 Further, in the SDP information held by the 
second server 100b, as shown in figure 2, initially, the 
URL of the lOD information and the transmission mode 
thereof are described in association with the data type 
(lOD). Thereafter, the URL of the ODS information and 
the transmission mode thereof are described in associ- 
ation with the data type (ODS) and, furthermore, the 
UBL of the SDS information and the transmission mode 
thereof are described in association with the data type 
(SDS). The transmission modes of the !OD information, 
the ODS information, and the SDS information are 
download type. 

[0072] Further, in the SDP information, the URL of 
eaoli entity data and Ihe transmission mode thereof are 
described in association with the data type (video, 
audio, or text) and, further, an Identifier of the object 
descriptor corresponding to each entHy data Is 
described. With respect to the entity data corresponding 
to the object such as a background stil! picture, a cyclic 
moving picture, text, or audio, the transmission mode of 
the entity data is described as download type. With 
respect to the entity data corresponding to a normal 
moving picture, the transmission mode of the entity data 
is described as stream type. Figure 3 shows the specific 
contents of the SDP information, ^n figure 3, the specific 
descriptions of the data types are omitted. 
[0073] In the SDP information, as shown in figures 
? and 3, the data typs is described in the form nf m = 
• • *, and the transmission mode and the URL are 
described In the form of a = * ' \ following the data 
type (m * ' * ). Further, the object identifier is 



described in the form of a = * • • , following the trans- 
mission mode and the URL (a = • • *). Table informa- 
tion which associates the object identifier for identifying 
one object with the URL indicating the location of object 

s data corresponding to this object, is composed of Ih^ 
transmission mode and the URL (a- * • which follow 
one data type (m =^ * • and the object identifier (a « 
» • • ) which follows the transmission mode and the 
URL (a ^ * • M 

10 [0074] Further, in the lOD information, as shown In 
figure 13(b), data of ODods (object descriptor) corre- 
sponding to the ODS informatfon itself and data of 
ODsds (object descriptor) corresponding to the SDS 
information itself are described with the corresponding 

15 header information, respeclivefy. Further, in the ODS 
information, as shown in figure 14(a), data of object 
descriptors (CD) corresponding to the respective 
objects constituting one scene are described together 
with the correspondins header information. Further, In 

£0 the SDS information, as shown in figure 14(b), data of 
scene descriptions SDl-SDn Indicating the scene con- 
struction of one scene corresponding to predetermined 
times i1 -In are described together with the correspond- 
ing header information. 

25 [0075J Further, in the object descriptor (OD) of the 
object identifier (id=100), as shown in figure 15(a), 
ODid=100 as the value of the object identifier (id), and 
ESid-10 and ESid=20 as elementary stream identifiers 
(id) are described and, furthermore, an identifier "Video" 

30 which indicates that this object is video data (between 
video data and audio data), and additional information, 
for example, information for decoding coded entity data, 
are described. The contents of the object descriptors 
(OD) having other object identifiers are similar to that 

35 shown in figure 15(a), Further, the description of ODods 
(object descriptor) corresponding to the ODS informa- 
tion itself and the description of ODsds (object descrip- 
tor) corresponding to the SDS information itself are 
similar to that shown in figure 15(a). 

40 [007$] Furthermore, in the scene description SD1 , 
as ^hown in figure 15(b), the hieiarchy of the objects 
constituting the scene at time t1 is described. The con- 
tents of the scene descriptions SD2-SDn at times t2~tn 
are similar to that shown in figure 1 5(b). 

4S [0077] Next, the operation of the data transmission 
system will be described. 

[0078] For example, in the state where the home 
pag^ HP ho!d by th^ third server iOOc ts displayed on 
the display unit of the client terminal 200 as shown in 

60 figure 10, when the user selects the character string 
"scene 1" in this home page HP by using a mouse 
pointer MP and clicks the mouse, a request for the SDP 
information corresponding to the scene 1 is output to 
the second server 100b which holds the SDP informa- 

55 tlon linked to the character string "scene 1 Thereby, 
the SDP information is transmitted from the second 
server 100b to the cEient terminal 200. 
[0079] Then, based on the contents of the SDP 
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information (refer to figure 2{b)), the client terminal 200 
starts the process to obtaEn the lOD information, the 
CDS Information, the SDS Information, and the entity 
data (object data) of the respective objects. 
[006D] Initially, the client terminal £00 outputs a 
request for the lOD information to the server B which 
holds the !0D information described at the beginning of 
the SDP information, by specifying the location (URL) 
and the transmission mode (download type transmis- 
sion) of the ]OD information. Then, the server B trans- 
mits the requested (OD Information to the olrent terminal 
200 by download typ^ transmission. Thereby, th« c!i&nt 
terminal 200 receives the lOD information from the 
server B. In this first embodiment, the downfoad li^e 
transmission employs HTTP (Hyper Text Transfer Proto- 
col) based on TCP (Transport Control Protocol). The 
lOD information contains data of ODiod corresponding 
to the ODS itself, and data of ODsds corresponding to 
the SDS itself. 

[00811 Next, the client terminal 200 outputs a 
request for the ODS information and the SDS informa- 
tion which are described in the SDP information, to the 
!?erver B which holds the ODS infornialion ar>d Ihe SDS 
Information, by specifying the locations (URL) and the 
transmission mode (download type transmission). 
Then, the server B transmits the requested ODS infor* 
mation and SDS information to the client terminal 200 
by download type transmission. Thereby, the client ter- 
minal 200 receives the ODS information and the SDS 
information from the server B. The ODS information is 
information including the object descriptors (OD) of all 
objects corresponding to one scene, and the SDS infor- 
mation is information including scene descriptions 
SD1~SDn corresponding to predetermined times tl^-tn 
in one scene. In this first embodiment, the request and 
acquisition of the ODS information and the SDS infor- 
mation are performed according to the HTTP based on 
the TCP. 

[0082] Further, the client terminal 200 outputs a 
request for the image data (entity data) of each object, 
on the basis oi the contents of Itie SDP information, by 
Specifying the transmission mode. 
[0083] To be specific, initially, the client terminal 200 
outputs a request for the image data (entity data) corre- 
sponding to the object such as a background still picture 
or a cyclic moving picture, to the second server 1 00b, by 
specifying the download type transmission as the trans- 
mission mode (the procoso ohown by [1] in figure 1). 
Then, the server 1 00b transmits the requested data to 
the client terminal 200 by the specified transmission 
mode, i.e., the HTTP based on the TCP (the process 
shown by [2| in figure 1). 

[0084] Thereby, the lOD information, the ODS infor- 
mation (object descriptors OD of ail the objects consti- 
tuling cn^ ^c^ne). ^nd the SDS information (scene 
descriptions SD1-SDn at predetermined times in one 
scene) are transmitted according to the highly reliable 
transmission protc^ol and, further the image data ot the 



download type objects are transmitted before transmis- 
sion of the image data of the stream type objects, 
[0085] Subsequently the client terminal 200 ana- 
lyzes the ODS information according to the object 

5 descriptor ODods to obtain the object descriptors OD 
(idrriOO, 200, 300, 400) of ail c^jects constituting one 
scene. Further, it analyzes the SDS information accord- 
ing to the object descriptor ODsds to obtain the scene 
descriptions SD1--SDn at predetermined times in one 

10 scene. Thereafter, the client terminal 200 performs 
decoding and composition of the entity data of the 
rsspeciive objects on th© basis of the object descriptors 
OD (id==100. 200, 300, 400) obtained from the ODS 
information and the scene descriptions SDI-^SDn 

16 obtained from the SDS Information, thereby reproduc- 
ing the image corresponding to one scene, 
[00861 Thereafter, the client terminal 200 outputs a 
request for the image data (entity data) corresponding 
to the object as a moving picture* to the first server 

20 1 00a, by specifymg the stream type transmission as the 
transmission mode (the process shown by [5] in figure 
1). Then, the server 100b transmits the requested data 
to tiie client terminal 200 by the specified stream type 
transmission (the process shown by [4] in figure 1). In 

S5 this first embodiment, the stream type transmission is 
performed according to RTP (Real Time Transport Pro- 
tocol) based on UDP (User Datagram Protocol). 
[0087] Hereinafter, the data transmission process 
between the server and the client terminal in the data 

50 transmission system of this first embodiment will be 
described in more detail. 

[0088] Figure 4 is a diagram for explaining the con- 
struction of the server 100 and the client terminal 200 in 
the system. In figure 4, for convenience's sake, the 

35 server 100 is shown as the first and second servers 
1 00a and 100b shown In figure 1 , 
[0089] The server 100 includes a hard disk (HDD) 
110, an HTTP message exchange unit 131, and an 
RTSP message exchange unit 141. The hard disk 110 

40 contains the entity data of the respective objects (object 
data), the SDP informaiton, the ODS Infoinialion, the 
SDS Information, and the like. The HTTP message 
exchange unit 131 exchanges an message transmitted 
by the HTTP (HTTP message) with the client terminal 

45 200, and outputs the URL of requested data, which Is 
included in the message. The RTSP message 
exchange unit 141 exchanges a message transmitted 
by the RTSP (RTSP message) with the client terminal 

200, and outputs the URl of requested data and the 
60 SSRG (channel id of the RTP), which are included \n the 
message. Further, the BTSP message exchange iinit 
141 receives an ackiowledge (ACK) of the URL from a 
data reading unit 120 which ts described later 
[0090] The server 1 00 further i ndudes a data read- 
55 mg unit 1!?0, an HTTP header generation unit 13P, and 
an HTTP data output unit 133. The data reading unit 
120 reads data Irom the hard disk 1 10 on the basis of 
the locations (URL) of the requested data from the 
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exchange units 131 and 141. The HTTP header gener- 
ation unit 132 generates an HTTP header correspond- 
ing to the read data. The HTTP data output unit 133 
adds the HTTP header to the read data and outputs the 
data, 

[0091] The server 100 further includes an RTF 
packet generation unit 142 and an RTP packet output 
unit 1 43. The RTP packet generation unit 1 42 generates 
an RTP packet corresponding to the read data, and 
gives the SSRC specified by the exchange unit 141 to 
the RTP packet. The RTP packet output unit 143 
receives tho RTP packot wtth the SSRC, and outputs 
the RTP packet in accordance with a port signaf from 
the message exchange unit 1 41 . 
10092] The client terminal 200 includes an HTTP 
data receiving unll 212 and an HTTP message 
exchange unit 21 1 . The HTTP data receiving unit 212 
receives the output from the HTTP data output unit 133 
of the server 1 DO, and outputs the URL of the entity data 
of each object and the object descriptor id thereof and, 
further, outputs the object descriptor OD, The HTTP 
message exchange unit 211 receives the output from 
the data receiving unit 212 (the UBL of the entity data of 
the download type object), exchanges an HTTP mes- 
sage with the HTTP message exchange unit 131 of the 
server 100, and outputs the URL 
[0093] Further, the client terminal 200 includes an 
RTSP message exchange unit 213 and an RTP data 
receiving unit 214. The RTSP message exchange unit 
213 receives the output from the HTTP data receiving 
unit 212 (the URL of the entity data of the stream type 
object) and the object descriptor id, exchanges an 
RTSP message with the RTSP message exchange unit 
141 of the server 100. and outputs the RTP port 
number, the SSRG. and other data. The RTP data 
receiving unit 214 receives the RTP packet from the 
RTP packet outptit unif 143 of the server 100, and out- 
puts the RTP data on the basis of the RTP port number, 
the SSRC, and other data which are output from the 
message exchange unit 213. 

[0094] Further, the client terminal 200 includes a 
video decoding unit 220 and a video composition unit 
230. The video decoding unit 220 decodes the coded 
image data (entity data) of each object on the basis of 
the output from the HTTP data receiving unit 212 and 
the output from the RTP receiving unit 214. The video 
composition unit 230 composites the decoded image 
data of the respective objeots on the basts of the ccono 
description information SD from the HTTP data receiv- 
ing unit 212, and ou^uts reproduced image data corre- 
sponding to one scene to the displa/ unit. 
[0095] Next, a description will be given of the oper- 
ations of the server 100 and the client terminal 200 dur- 
ing the data transmission process between the server 
1 00 and the client terminal :^00 
[0096] Figure 3 is a diagram showing the contents 
of the SDP information, the contents of the scene 
description information SD. and the relation of the 



scenes to be reproduced, which are treated in the data 
transmission system. Figure 5 is a diagram for explain- 
ing the procedure of session set up in the data transmis- 
sion system, i.e., the procedure to obtain image data of 

J VriQ respective objects constituting one scene. 

[0097] Hereinafter, a description will be given of the 
case where the client terminal 200 obtains the respec- 
tive objects ob1-ob4 constituting the composite image 
G1 shown in figure 11 (b), and reproduces and displays 

10 the composite image G1 - 

P09S} Accordingly, in figure 3, the SDP information 
Indicates that the object ob1 having the object descrip- 
tor (id=100) is the background still picture in the com- 
posite image G1 shown in figure 11(b), and its entity 

16 data D_V0#1 is data stored in the server B, for which a 
transmission request is to be made according to the 
protocol (HTTP) corresponding to the download type 
transmission. Further, the SDP information indicates 
that the object ob2 having the object descriptor (id=200) 

BO is the cyclic moving picture (volcano) as the first fore- 
ground in the composite image G1 shown in figure 
11Cb), and its entity data D__V0#2 is data stored in the 
server B, for which a tt^nsmtssion request is to be made 
according to the protocol (HTTP) corresponding to the 

26 download type transmission. Further, the SDP informa- 
tion indicates that the objects ob3 and ob4 having the 
object descriptors (id=300,400) are the moving picture 
(big dinosaur) as the second foreground image and the 
moving picture (small dinosaur) as the third foreground 

30 image in the composite image G1 shown in figure 1 1(b), 
respectivefy, and their entity data S„V0#1 and S_VO#a 
are data stored in the server A, for which transmission 
requests are to be made according to the protocol 
(RTP) corresponding to the stream type transmission, 

35 [0099] Further, in figure 3, the scene description 
(SD) indicates the hierarchy of the objects constituting 
the scene G1. To be specific, assuming that the scene 
G1 corresponds to the lirst layer of the hierarchy, the 
object having the ODid of 1 00 and the object having the 

40 ODid of 200 belong to the layer lower than the first layer, 
le., the second layer, and the object having the ODId of 
300 and the object having the ODid of 400 belong to the 
layer bwer tian the object CODid-200) in the second 
(ayer, i,e., the third layer. 

45 [01001 In the client terminal 200, when the user 
instructe the client terminal 200 to obtain the scene 
(composite image) G1 shown In figure 11(b). the HTTP 
meseage exchange unit 21 1 outputs a request for the 
SDP information, by specifying the URL of the SDP 

60 information, to the HTTP message exchange unit 1 31 of 
the server 100, Then, the exchange unit 131 of the 
server 100 transmits the URL of the SDP information to 
the data reading unit 120, and the data reading unit 120 
reads the SDP information from the hard disk 1 10. The 
read SDP tnfnrmatinn is given a hsRrier which iJi gener- 
ated in the HTTP header generation unit 132, and the 
SDP information with the header is transmitted from the 
HTTP data output unit 133 to the client terminal 200. 
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The request and output of ihe SDP information are per- 
formed according to the HTTP. 
[0101] When the SDP information output from the 
data output unit 133 of the server tOO is received by the 
HTTP data receiving unit SI 2 of the client terminal 200, s 
the receiving unit 212 analyzes the SDP information. 
[0102] Initially, the receiving unit 212 instructs the 
message exchange unit 21 1 to make a request for the 
lOD information which is described at the beginning of 
the SDP information, and the message exchange unit 

21 1 outputs a request for the !0D information, by spec- 
ifying the URL of the lOD information, to the HTTP mes- 
sage exchange unit 131 at the server end. Thereby, the 
lOD Information is output from the output unit 133 at the 
server end to the receiving unit 212 at the client end. 
The request and output or the iod information are also 
performed according to the HTTP. 
[01031 When the iOD information output from the 
data output unit 133 of the server 100 is received by the 
HTTP data receiving unit 21 2 of the client terminal 200, 
the receiving unit 212 analyzes the IOD information, 
thereby obtaining the data of ODods corresponding to 
the ODS information and ih& data of ODsds corre- 
sponding to the SOS information. 
[0104| Next, the receiving unit 212 at the client end 
instructs the message exchange unit 211 to make a 
request for the ODS information and the SDS informa- 
tion which are described after the SOD information in the 
SDP information, and the message exchange unit 211 
outputs a request for the ODS information and the SDS 
information, by specifying their locations (URL), to the 
HTTP message exchange unit 131 at the server end. 
Thereby, the ODS information and the SDS information 
are output from the ou^ut unit 133 at the server end to 
the receiving unit 212 at the client end. The request and 
output of the ODS information and the SDS information 
are also performed according to the HTTP. 
[01051 When the ODS information and the SDS 
information output from the data output umt 133 of the 
server 100 are received by the HTTP data receiving unit 

212 of the client terrninaf 200, the receiving unit 213 
analyzes the ODS information and the SDS information 
in accordance with their object descriptors ODods and 
ODsds, thereby obtaining the object descriptors DS of 
all objects corresponding to one scene, and the scene 
descriptions SDI-SDn corresponding to times tl-tn of 
the scene. These ODS information and SDS informa- 
tion are transmitted from ih© server B io tho client end, 
in Uie same manner as described for the SDP informa- 
tion and the IOD information. The request and acquisi- 
tion of the ODS information and the SDS information 
are performed according to the HTTP based on the 
TCP 

[01061 Thereby, the client end obtains the object 
descriptors (OD) of all objects constituting the selected 
scene, and the scene descriptions SD1-SDn corre- 
sponding to times tl-tn of the scene. The object 
descriptors (OD) are output to the video decoding unit 



220 while the scene descriptions SD1--SDn are output 
to the video composition unit 230. 
[0107] Thereafter, at the cftent end. the HTTP data 
receiving unit 212 and the HTTP message exchange 
unit 211 make a request for the entity data D_VO#1 of 
the download type object obi, on the basis of the con- 
tents of the SDP information, by specifying that the data 
transmission should be performed by the download type 
transmission using the HTTP, as well as the URL of the 
entity data. When this request has arrived at the HTTP 
message exchange unit 131 of the server B, the 
exchange unit 131 transmits th© URL of the entity data 
D_V0#1 to the data reading unit 120, and the data 
reading unit 120 reads the entity data D_V0#1 from the 
hard disl^ 1 1 0. The entity data D„V0#1 output from the 
data reading um v^o is given a predetermined header 
by the HTTP header generation unit 132, and the entity 
data D_V0#1 with the header is output from the HTTP 
data output unit 133 to the client end. 
[0108] When the entity data D__V0#1 has been 
received by the HTTP data receiving unit 212 at the cli- 
ent end, request and acquisition of the entity data 
D__VO#2 of the next object are performed in the same 
manner as described for the entity data D_V0#1, The 
entity data received by the receiving unit 212 are sue- 
cessiveiy supplied to ihe video decoding unit 220 and 
then output to the video composition unit 230. 
[0109] Next, in the client terminal 200, the RTSP 
message exchange unit 213 and the RTSP data receiv- 
ing unit 214 make a request for the image data (entity 
data) S„VO#1 corresponding to the object as a moving 
picture, on the basis of the SDP information, by specify- 
ing that tie data transmission should be performed by 
the stream type transmission using the RTF, as well as 
the URL of the entity data, the RTP port signal, and the 
SSRC. 

[0110] When this request has arrived at the RTSP 
message exchange unit 141 of the server B, the 
exchange unit 141 outputs the UBL of the entity data 
S_V0#1 to the data reading unit 120. At this time, the 
3SR0 i& output to the RTP packet generation unit 142 
while the port signal is output to the RTP packet output 
unit 143. 

[01 1 1 1 Then, the data reading unit 1 20 checks as to 
whether the entity data exists in the specified URL or 
not. When the entity data exists in the URL, an ACK sig- 
nal is output to the RTSP message exchange unit 1 41 . 
[0112] Nejxt, a r^quoet for tho Emag© data (entity 
data) S_VO#2 is made by specifying that the data trans- 
mission should be performed by the stream type trans- 
mission using the RTR as well as the URL of the entity 
data, the RTP port signal, and the SSRC. As described 
above^ when the entity data exists in the specified URL, 
an ACK signal is output to the RTSP mes^ge 
exchange unit 141. 

[0113] In this way, successive setup is performed 

tor the entity data of the stream type object. 

[0114] When a PLAY signal (reproduction start sig- 
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nal) for each stream type object is transmitted Irom the 
RTSP message exchange unit 213 at the client end to 
the RTSP message exchange unit 1 41 at the server end 
in accordance with the user's operation, the entity data 
of each stream type object transmitted from the 
server to the client. The PLAY signals (reproduction 
start signals) for the respective stream type objects way 
be transmitted object by object, or in a [ump. 
[01151 That is, the data reading unit 120 reads the 
above-^Jescf toed entity data S_V0#1 and S_V0#2 from 
the hard disk 11 0 , and the read entity data S„V0#1 and 
3_VO#S are output from the data reading unit 120 to the 
RTF packet generation unit 1 42. In the RTF packet gen- 
eration unit 142, the entity data S_V0#1 and S„V0#2 
are packetized, and each RTF packet is given the 
SSRC as the channel id specified by the client. These 
RTF packets are output from the RTF packet generation 
unit 143 to the client end according to the RTR 
[0116] When the entity data S_VO#1 and S_VO#2 
have been received by the RTF data receiving unit 214 
at the client end, these entity data are successively 
taken from the packets on the basis of the port signal, 
the SSRG, and other additional information, and 
decoded by the video decoding unit 220, and thereafter, 
output to the video composition unit 230. 
[0117] In the video composition unit 230, the down- 
load type entity data D_VO#1 and D_V0#2 and the 
stream type entity data S_V0#1 and S„V0#2 are com- 
posited according to the scene description information. 
Then, scene data corresponding to one scene is output 
to the display unit, and the scene is displayed, 
[0118] As described above, according to the first 
embodiment of the present invention, amongst the 
image data (entity data) corresponding to the respective 
objects constituting one scene, the image data corre- 
sponding to the objects as a still picture and a cyclic 
moving pjctur© ar© transmitted before reproduction of 
the scene data corresponding to one scene is started at 
the receiving end. Therefore, extreme increase in the 
data transmission quantity during scene reproduction is 
avoided, and the consumption ot the transmission band 
of the network is minimized, 

[0119] Further, the control information {SDF infor- 
mation) for performing transmission and reproduction of 
the image data corresponding to the respective objects 
includes the transmission mode identification informa- 
tion Indicating whether the object data corresponding to 
e^ch object should be ti^nsmllted by the download type 
transmission or the stream type transmission, and the 
SDP information is transmitted as the initial transmis- 
sion data to the receiving end in the transmission proc- 
ess for the scene data corresponding to one scene, by 
the transmission mode using the highly reliable proto- 
col, while the scene description information (SDS) and 
the object relevant information (ODS) are transmitted by 
the transmission mode using the highly reliable proto- 
col Therefore, reHable Image reproduction at the receiv- 
ing terminal is assured. 



[01 20] Further, when the scene data corresponding 
to one scene composed of plural objects is transmitted 
object by object from the transmitting end to the receiv- 
ing end, the SDP information includes the table informa- 

Q tion which aocootcttee the object identifier given to each 
object for identifying the object with the URL corre- 
sponding to each object which indicated the location of 
the object data for reproduction and display of the 
object. Therefore, at the receiving end, each object can 

io be associated with the URL of the corresponding object 
data, on the basts of the table information. 
[0121 1 While In thie f tret embodiment the ODS infor- 
mation (i.e., object descriptors OD of all objects) and the 
SDS information (scene descriptions SDI^SDn at 

IS times t1 --tn) are obtained separately from the sen/er, 
these information may be obtained as one file from the 
server 

[Eimbodiment 9] 

20 

[0122] Figure 6 is a diagram for explaining a data 
transmission system according to a second embodi- 
ment ot the present invention, illustrating the procedure? 
of session setup in this data transmission system. 

25 [0123] In the system of this second embodiment, 
the above-described SDP information, tOD informationp 
ODS information (object descriptors OD of all objects) 
and SDS information (scene descriptions SDI-SDn at 
times tl-tn) are stored together, as setup file informa- 

Bo tion (MSF information) in a predetermined server. 

[0124] In this second embodiment, for example, in 
the state where a home page HP held by a predeter- 
mined server ts displayed on the display unit of the client 
terminal 200 as shown in figure 10, when the user 

35 selects the character string "scene 1 " in the home page 
HP by the mouse pointer MP and clicks the mouse, a 
request for the MSF information corrfiiipondirtg to the 
scene 1 is output to the server which holds the MSF 
information linked with the character string "scene 

40 Thereby, the MSF information is transmitted from the 
server lo the client terminal 200. The transmission o1 
the MSF Information Is performed by download type 
transmission according to HTTP (Hyper Test Transfer 
Protocol) based on TCP (Transport Control Protocol). 

45 [0125] Then, based on the contents of the SDP 
information stored tn the MSF information (refer to fig- 
ure 2), the client terminal 200 starts the process of 
obtaining the lOD information and the entity data of the 
respective objects. 

50 [0126] The subsequent transmission process is 
identical to that described for the first embodiment- 
[0127] [n the second embodiment so constructed, 
since the SDP information, the lOD information, the 
ODS information (object descriptors OD of all objects), 

ss and the SDS Information (scene descriptions SD1 ~SDn 
at times ti ~tn) are obtained together as setup file infor- 
mation (MSF information), the process of obtaining the 
control information is facilitated as compared with that 
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of the first embodiment in which the SDP information, 
the lOD information, the ODS Information, the SDS 
informafion, and the litce are separately obfamsd, 
[01281 While in the first and second embodiments 
image data has t)een described as object dam corre- 
sponding to each of plural objects constituting one 
scene, the object data may be audio data. Further, the 
imaae data is not restricted to data of an image (natural 
image). It may be CG (computer graphics) data or text 
data. 

[0129] While In the first embodiment the table infor- 
mation which associates the URL of the entity data of 
each object with the ODid o1 the object is stored in the 
SDP information, this table information may be sepa- 
rated from the SDF information and transmitted from 
the server to the client before or after sending the SDP 
information. 

[01301 While in the second embodiment tfie table 
information which associates the URL of the entity data 
of each object with the ODId of the objed is stored in the 
SDP information in the MSP information, this table irrfor- 
mation may be stored in the MSP information separately 
from the SDP inlormation. 

[01 31 ] Further, while in the first and second embod- 
iments the SDS information has been described as data 
(control information) for specifying the hierarchy of plu- 
ral objects constituting a scene and the locations of 
these objects in the scene, the control iriformation es not 
restricted to the SDS information. 
[0132] For example, instead of the SDS informa- 
tion, SMIL (Synchronized Muftimedia (ntegration Lan- 
guage) may be employed. Also in this case, as in the 
aforementioned embodiments, object data correspond- 
ing to objects such as audio, video, and text can be 
transmitted or received by the download type transmis- 
sion or the stream l^e transmission. Further, when the 
SMIL includes information identical to th^ lOD informa- 
tion, the ODS information, or the SDP information, it is 
not necessary to fe'ansmil the information. 
[01331 Furthermore, while in the first and second 
embodiments data transmission between a server and 
a client terminal has been described, the server and the 
client terminal may be personal computers, and the 
server may be a wortetation. Further, in the case of 
data transmission between a first visual phone and a 
second visual phone, both of the data transmitting end 
and the data receiving end are client terminals. 
[0134] PurlherEngie, in the data transmission sys- 
tems according to the first and second embodiments, 
the download type transmission is performed according 
to HTTP (Hyper Text Transfer Protocol) based on TCP 
{Transport Control Protocol) while the stream type 
transmission is performed according to RTP (Real Time 
Transport Protocol) based on UDP (User Datagram Pro- 
tocol). However, the download type transmiseion and 
the Stream type transmission are not restricted to those 
mentioned above. 

[0135] For example, when it is secured that the 



band width or the error rate in the network is at a fixed 
level, it is possible to perform the stream type transmis- 
sion according to HTTP based on TCP. 



1 . A data transmission method for transmitting plural 
pieces of object data for reproducing plural objects 
constituting a scene, from the transmitting end to 

TO the receiving end, said method comprising: 

a first transmlcoion procces of transmitting first 
object data, amongst the plural pieces of object 
data, such that reproduction of the scene Is 
15 performed at the receiving end on the basis of 

the first object data after the transmission of the 
first object data has been completed; and 
a second transmission process of transmitting 
second object dflta other thr^n the first ohjerf 
20 data, amongst the plural pieces of object data, 

such that reproduction of the scene is per- 
formed at me receiving end on the basis of the 
second object data during the transmission of 
the second object data- 

2. A data transmission method for transmitting scene 
data for reproducing a scene, from the transmitting 
end to the receiving end, said method comprising: 

30 a first transmission process of transmitting first 

data which is a part of the scene data, in 
accordance with a first transmission protocol 
which does not necessarily perform retrans- 
mission against transmission errors; and 

35 a second transmissior^ process of transmitting 

second data which is a part of the scene data, 
In accordance with a second transmission pro- 
tocol which performs retransmission against 
transmission errors; 

40 wherein said second data is scene description 

information and {^Ject relevant Information, 
said scene description information indicating 
the hierarchy of the respective objects consti- 
tuting the scene, by object identifiers which are 

46 given to the respective objects for identifying 

these objects, and said object relevant informa- 
tion indicating additional information relating to 
the respective objeGts, in association with the 
object identifiers of the respective objects. 

50 

3. A data transmission method for transmitting scene 
data for reproducing a scene, from the transmitting 
end to the receiving end^ said method comprising 
the steps of: 

es 

transmitting object data for reproducing plural 
objects constituting the scene, object by ctoject, 
from the transmitting end to the receiving end; 
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and 

transmitting table information from the transmit- 
ting end to the receiving end, satd t^le infor- 
mation associating an object identifier given to 
each object for Identifying Uie object, wilii loGa- 5 
tiort information indicating the location of object 
data corresponding to the object, 

4. A data transmission system comprising : 

10 

a data transmission apparatus for transmitting 
plural ptccco of object data for roproducing plu- 
ral objects constituting a scene; and 
a data receiving apparatus for receivrng the 
plural pieces of object data and reproducing is 
the scene on the basis of the object data; 
said data transmission apparatus comprising; 

a first transTtiiasion unit for transmittirto firi^t 
object data, amongst the plura! pieces of 20 
object data, such that reproduction of the 
scene Is performed at the receiving end on 
the basis of tne trrst o&|eci data after the 
transmission of the first object data has 
been completed, and ss 
a second transmission unit for transmitting 
second object data other than the first 
object data, amongst the plural pieces of 
object data, such thai reproduction of the 
scene is performed at the receiving end on so 
the basis of the second object data during 
the transmission of the second object data. 

5. The data transmission system of Claim 4, wherein 
said data transmission apparatus transmits, by 35 
using the first transmission unit, control information 

for controiHng transmission of the object data and 
reproduction of the objects, as initial data to be 
transmitted to the receiving end in the transmission 
process for data corresponding to one scene, said 40 
control information including transmission mode 
identiticatton information indicating that the object 
data corresponding to each of the objects constitut- 
ing one scene is to be transmitted by the first trans- 
mission unit or the second transmission unit 45 

6. A data transmission system comprising: 

a data transmission apparatus for transmitting 
scene data for reproducing a scene; and so 
a data receiving apparatus for receiving the 
scene data and reproducing the scene; 
said data transmission apparatus comprising; 

a first transmission unit for transmitting first ss 
data which is a part of the scene data, in 
accordance with a first transmission proto- 
col which does not necessarily perform 



retransmission against transmission 
errors, and 

a second transmission unit for transmitting 
second data which Is a part of the scene 
data, ill acccsfdanoe with a second trans- 
mission protocol which performs retrans- 
mission against transmission errors, and 
said second transmission unit transmitting, 
as the second data, scene description 
information and object relevant informa- 
tion, said scene description information 
indicating tho hierarchy of the reepectiv© 
objects constituting the scene, by object 
identifiers which are given to the respective 
objects for Identififlng these objects, and 
said object reievant information indicating 
additional information relating to the 
respective objects, in association with the 
object identifiers of the respective objects. 

7. A data transmission system comprising: 

a data transmission apparatus for transmitting, 
object by object, object data for reproducing 
plural objects constttuiing a scene; and 
a data receiving apparatus for receiving the 
object data and reproducing the scene on the 
basis of the object data; and 
said data transmission apparatus comprising 
an information transmission unit for transmit- 
ting table information which associates an 
object identifier given to each object for identi- 
fying the object, with location information indi- 
cating the location of object data corresponding 
to the object. 

8. The data tmrismiKSSion syj^tem of CMm 1. wherein 
said information transmission unit transmits the 
table information in such a manner that the tabJe 
information is included in control information for 
controlling transmission of the object data and 
reproduction of the objects, said control information 
being initial information to be transmitted to the 
receiving end in the transmission process for data 
corresponding to the scene. 

9. The data transmission system of Claim 7, wherein 
said information transml^ton unit transmits the 
table information in such a manner that the table 
Information is included in object relevant informa- 
tion which indicates additional information relating 
to the respective objects in association with object 
identifiers of the respective objects. 

10. A data receiving method for receiv/lng plural pieces 
Of object data for reproducing plural objects consti- 
tuting a scene, transmitted from the transmitting 
end, and reproducing the scene on the basis of the 
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object data, said method comprising: 

a first receiving process of receiving first object 
data amongst the plural pieces of object data, 
and reproducing the scene on the basis of the 
first object data after the reception of the object 
data has been completed; and 
a second receiving process of receiving sec- 
ond object data other than the first object data 
amongst the plural pieces of object data and, 
simultaneously, reproducing the scene on the 
basia of the second object data. 

11. A data receiving method for receiving scene data 
for reproducing a scene, transmitted from the trans- 
mitting end, and reproducing the scene, said 
method comprising: 

a first receiving process of rece^iving firs* data 
which is a part of the scene data, transmitted 
according to a first transmission protocol which 
does not necessarily perform retransmission 
against transmission errors; and 
a second receiving process of receiving sec- 
ond data which is a part of the scene data, 
transmitted according to a second transmission 
protocol which performs retransmission 
against transmission errors; 
wherein said second data is scene description 
Information and object relevant information, 
said scene description information indicating 
the hierarchy of the respective objects consti- 
tuting the scene, by object identHiers corre- 
spending to the respective objects, and said 
object relevant Information indicating additional 
information relating to the respective objects, in 
asscjci^tiori with the object identifiers of the 
respective objects. 

12. A data receiving method for receiving scene data 
tor reproducing a scene, transmitted irom the trans- 
mitting end, and reproducing the scene, said 
method comprising the steps of: 

receiving object data for reproducing plural 
objects constituting the scene, which are trans- 
mitted object by object from the transmitting 
end; and 

receiving table information transmitted from the 
transmitting end, said table information associ- 
ating an object identifier given to each object 
for identifying the object, with location informa- 
tion indicating the location of object data corre- 
sponding to the object. 

13. A data receiving apparatus Ibr receiving plural 
pieces of object data for reproducing plural objects 
constituting a scene, transmitted from the transmit- 
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ting end, and reproducing the scene on the basis of 
the object data, said apparatus comprising: 

a first receiving unit for receiving first object 
daia among&t llie plural pieces of object data; 
a second receiving unit for receiving second 
object data other than the first object data 
amongst the plural pieces of object data; and 
a reproduction unit for reproducing the scene 
on the basis of the first object data and the sec- 
ond object data, in which scene reproduction 
bacod on the firct object dati^ is performed after 
reception of the first object data has been com- 
pleted, while scene reproduction based on the 
second object data is performed tn parallel with 
the reception of the second object data. 

14. The data receiving apparatus of Claim 13 wherein: 

control Information for controlling transmission 
of the object data and reproduction of the 
objects is received by the first receiving unit, as 
Initial data transmitted to the receiving end in 
the transmission process for data correspond- 
ing to the scene; and 

the object data corresponding to each object is 
received by one of the first and second receiv- 
ing units, according to transmission mode iden- 
tification information wh^ch is included in the 
control information and indicates that the object 
data is to be received by the first receiving unit 
or the second receiving unit 

1 5. A data receiving apparatus for receiving scene data 
lor reproducing a scene, transmitted from the trans- 
mitting end, and r^roducing the scene, said appa- 
ratus comprising : 

a first receiving unit for receiving first data 
which IS transmitted as a part of the scene data 
In accordance with a tlrst transmission protocol 
that does not necessarily perform retransmis- 
sion against transmission errors; and 
a second receiving unit lor receiving second 
data which is transmitted as a part of the scene 
data in accordance with a second transmission 
prdocol that performs retransmission against 
transmission errors; and 
said second receiving unit receiving, as the 
second data, scene description Information 
and object relevant information, said scene 
description information indicating the hierarchy 
of the respective objects constituting the 
scene, by object identifiers corresponding to 
tho respective objects, and said object relevant 
information Indicating additional information 
relating to the respective objects, in association 
with the object IdentHiers of the respective 
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1 6. A daia receiving apparatus for receM ng object data 
for reproducing objects constituting a scene, trans- 
mitted object by objeot from the transmitting end, ^ 
and reproducing the scene, said apparatus com- 
prising: 

a first receiving unit for receiving first data 
whicli is transoiltted as a part of the scene data io 
in accordance with a first transmission protocol 
that dose not n^c^D^arily perform retransmis- 
sion against transmission errors; and 
a second receiving unit for receiving second 
data which is transmitted as a part of the scene 16 
data in accordance with a second transmission 
protocol that performs retransmission agamst 
transmission errors; and 
said second receiving unit receiving, as the 
second data, table information transmitted from 20 
the transmitting end, said table information 
associating an object identifier given to each 
object for identifying the objecl:, with location 
information indicating the location of object 
data corresponding to the object, S5 

17. The data receiving apparatus of Claim 16, wherein 
said second receiving unit receives the table infor- 
mation as information included sn control informa- 
tion for controlling transmission of object data so 
corresponding to the respective objects and repro- 
duction of the objects, said control information 
being received first as the scene data correspond- 
ing to one scene, 

35 

18. The data receiving apparatus of Claim 16, wherein 
said second receiving unit receives the table infor- 
mation as information included in object relevant 
information transmitted from the transmitting end, 
said object rel errant Information indicating addi- 40 
tiona! information relating to tf le respective objeots, 

In association with object identifiers of the respec- 
tive objects. 



so 



55 



17 



BP 1 009 140 A2 



stream t^e 
object data 



100a 



f pre-download type 
object data 

scene description (SD) 
object descriptor (00) 

session ctescriptton 
I, protocol (SDP) 




RTSPACP 



client 
(dsplay tetmrnal) 



1000 



200 









server C 








■# f tow 


of data 



flow of message 



18 



EP1 009140 A2 



Fig.2 

(SOP .Session Description Protocol) 



fTF data type (lOD) 



a = 


transmission model 


URLof lOD 


m= 


data type (OOS) 




- 


transmlssionmodel ] 


URLof ODS 




object id 






datatype (SDS> 




a= 


transmission mode | 


URLof SDS 








a" 


object id j 




* 


data type {video) 




a = 


transmission mode 


URL of entity data 1 


a= 


object id j 






data type (audio) 




a = 


transmission model | 


URL of entity data | 


a = 


object (d 






data type (text) 




a ~ 


transmission mode 


URL of entity data 


a = 


object id | 





19 



EP 1 0D9 140 A2 




20 



EP1 009 140 A2 



T3 



O 
CM 



a 

o 

CM A 





> 

tion 




videc 
composi 
unit 


tit 


ttt 








decodi 
unit 




> 



21 



EP 1 009 140 A2 



Fig.5 
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Fig.6 
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